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ABSTRACT 


In a typical multiobjective optimization problem, solution exists in the form of a set 
of points, known as nondominated or Pareto-optimal points. In trying to solve mul- 
tiobjective optimization problems, most traditional methods scalarize the objective 
vector into a single objective. In those cases, the obtained solution is highly sensi- 
tive to the weight vector used in the scalarization process and demands the user to 
have knowledge about the underlying problem. Moreover, in solving multiobjective 
problems, designers may be interested in a set of Pareto-optimal points, instead of 
a single point. Since genetic algorithms(GAs) work with a population of points, it 
seems natural to use GAs in multiobjective optimization problems to capture a num- 
ber of solutions simultaneously. Although a vector evaluated GA (VEGA) has been 
implemented by J. D. Schaffer and has been tried to solve a number of multiobjective 
problems, the algorithm seems to have potential bias against middling individuals. 
As a result, its population tended to drift towards individual optima of objectives. 
A new algorithm, Nondominated Sorting Genetic Algorithm (NSGA), is developed 
and implemented in this thesis based on David Goldberg’s suggestion. This algo- 
rithm not only takes care of the unavoidable bias in VEGA but also distributes the 
population over Pareto-optimal regions. This helps to find multiple Pareto-optimal 
points in a single run. The proof-of-principle results obtained on three test problems 
used by Schaffer and others, show a promising future of NSGA. NSGA is also applied 
to two real-world engineering problems. A number of suggestions for extension and 
application of the algorithm is also discussed. 
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Chapter 1 


Introduction 


Most real-world design or decision making problems involve simultaneous optimiza- 
tion of multiple objectives. In principle, multiobjective optimization is very different j 
than the single-objective optimization. In single objective optimization, one attempts 
to obtain the best design or decision, w’hich is usually the global minimum or the global 
maximum depending on the optimization problem is that of minimization or maxi- 
mization. In the case of multiple objectives, there may not exist one solution which 
is best (global minimum or maximum) with respect to all objectives. In a typical 
multiobjective optimization problem, there exists a set of solutions which are supe- 
rior to the rest of solutions in the search space in all objectives but are inferior to 
any other solution in the set in one or more objectives. These solutions are known 
as Parefo-oph'ma/ solutions or nondominated solutions (Chankong and Haimes, 1983; 

Hans, 1988). The rest of the solutions are known as dominated solutions. Since 
none of solutions in the nondominated set is absolutely better than any other, any 
one of them is theoretically an optimal solution. The choice of one solution over the 
other requires problem knowledge and a number of problem-related factors. Thus, 
one solution chosen by a designer may not be acceptable to another designer or in a 
changed environment. Therefore, in multiobjective optimization problems, it may be 
useful to have a knowledge about alternative Pareto-optimal solutions. 
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In trying to solve multiobjective problems, most traditional methods scalarize 
a vector of objectives into one objective by averaging the objectives with a weight 
vector. This process allows a simpler optimization algorithm to be used, but the 
obtained solution highly depends on the weight vector used in the scalarization pro- 
cess. Moreover, if available, a decision maker may be interested in knowing alternate 
solutions. Since genetic algorithms (GAs) work on population of points, a number of 
Pareto-optimal solutions may be captured using GAs. An early GA application on 
multiobjective optimization by J. D. Schaffer (1984) opened a new avenue of research 
in this field. Though his algorithm, VEGA, gave encouraging results, it suffered from 
its biasness against some Pareto-optimal solutions. 

A new algorithm, Nondominated Sorting Genetic Algorithm (NSGA), is devel- 
oped and implemented in this thesis based on David Goldberg’s suggestion (Goldberg, 
1989). This algorithm not only takes care of the unavoidable bias in VEGA but also 
distributes the population over Pareto-optimal regions. This thesis briefly describes 
the difficulties of using three common classical methods to solve multiobjective op- 
timization problems. A brief introduction to Schaflfer’s VEGA and its problems are 
outlined. Thereafter, the nondominated sorting GA is described and applied to three 
test problems and two real world engineering problems. Experimental results for these 
test functions are compared and analyzed with that of VEGA. Chapter 2 introduces 
multiobjective optimization and concepts of Pareto-optimality. It also presents three 
classical methods and their drawbacks. Chapter 3 introduces genetic algorithms in 
function optimization. Chapter 4 discusses Schaffer’s vector evaluated genetic algo- 
rithm and its shortcomings. Chapter 5 presents the nondominated sorting genetic 
algorithm, NSGA, and its implementation. Simulation results of three test functions 
and performance analysis in case of VEGA and NSGA arer presented in Chapter 6. 
Chapter 7 presents the successful application of NSGA on two engineering multiob- 
jective optimization problems. Chapter 8 discusses the possible extensions of this 
algorithm. Conclusions are presented in chapter 9. 



Chapter 2 

Multiobjective Optimization - 
Classical Methods 


This chapter introduces the nmltiobjective optimization problem and discusses three 
classical methods to solve multiobjective optimization problems. It also presents the 
difficulties of using these methods. 


2.1 Multiobjective Optimization Problem 

A general multiobjective optimization problem consists of a number of objectives and 
is associated with a number of inequality and equality constraints. Mathematically, 
the problem can be written as follows (Rao, 1991): 

Minimize/Maximize /i(x) i = 1, 2, . . . , 

Subject to 5'j(x) < 0 j = l,2, ...,J (2.1) 

hk{x) = 0 k=1^2,...,K 

The parameter x is a p dimensional vector having p design or decision variables. In a 
single-objective optimization problem, one can find a unique point which is a global 
optimum. But in this vector optimization problem, solution exists in the form of a set 
of satisfying solutions. This is because there is always an alternative which is better 
in one objective or other. This concept is further discussed in the following section. 
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2.2 Concept of Nondominance 

Solutions to a multiobjective optimization problem are mathematically expressed in 
terms of nondominated or superior points. In a minimization problem, a vector x is 
partially less than another vector y, (x -< y), when no value of y is less than x and 
at least one value of y is strictly greater than x. In other w’ords, 

(x) -< (y) (V,) {x, < ?/,) and 

(3.) (xi < yi). 

If X is partially less than y, we say that x dorninates y or y is inferior to x (Tamura 
and Miura, 1979). Any member of such vectors which is not dominated by any other 
member is said to be nondominated or non-inferior. Computationally, we say y is 
dominated if the following conditions are satisfied : 

/.(x) < /.(y) for all f and 

fi(x) < fiiy) for at least one ?, 

where /, is z-th objective. It is important to note that the above conditions are 
true for minimization only. If the objective is to maximize a function we define 
a dominated point if the corresponding component is not greater than that of a 
nondominated point. In this case one has to redefine the equation 2.2 by simply 
changing the relational operator from less-than or less-than-equal-to type to greater- 
than or greater-than-equal-to type. This way, we can also extend this methodology to 
handle minimization of a set of functions at the same time maximizing another set. 
The optimal solutions to a multiobjective optimization problem are nondominated 
solutions. They are also known as Pareto-optimal solutions. Mathematically, an 
optimization algorithm should be terminated if any one of the Pareto-optimal solution 
is obtained. But in practice, since there could be a number of Pareto-optimal solutions 
and the suitability of one solution depends on a number of factors including designer’s 
choice, problem environment, a knowledge of multiple Pareto-optimal solutions is 
desired. 
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The following section describes three classical approaches to the solution of multi- 
objective optimization problems and discusses their difficulties by illustrating a simple 
two-objective optimization problem. 

2.3 Classical Methods 

Even though there exists a number of techniques to solve multiobjective optimization 
problems, a common difficulty with multiobjective optimization is the appearance of 
an objective conflict (Hans, 1988) — none of the feasible solutions allow simultaneous 
optimal solutions for all objectives. In other words, individual optimal solutions of 
each objective are usually different. Thus, a mathematically most favorable Pareto- 
optimum is that solution which offers least objective conflict. But such solutions 
may not satisfy a decision-maker because he may want a satisfying solution according 
to the associated priorities of objectives. To find such points, all classical methods 
scalarize the objective vector into one objective. Most of the classical algorithms 
for non-linear vector optimization define a substitute problem, reducing the vector 
optimization to a scalar optimization. Using such substitute, a compromise solution 
is found subjected to specified constraints. 

In the following subsections, three commonly-used methods — method of objective 
weighting, method of distance functions, and method of min-max formulation — are 
discussed. 

2.3.1 Method of Objective Weighting 

This is probably the simplest of all classical techniques. Multiple objective functions 
are combined into one overall objective function, Z, as follows: 

^ = ( 2 - 3 ) 

i=l 

where x € X, the weights Wi are fractional numbers (0 < w, < 1), and all weights are 
summed up to one, or tu,- = 1. In this method, the optimal solution is controlled 



6 


by the weight vector w . It is clear from above equation that the preference of an 
objective can be changed by modifying the corresponding weight. Mathematically, 
a solution obtained with equal weights to all objectives may offer least objective 
conflict, but as a real-world situation demands a satisfying solution, priority must be 
induced in the formulation. In most cases, each objective is first optimized and then 
the solutions obtained are used to choose the weight vector. The only advantage of 
using this technique is that the obtained solution is a guaranteed Pareto-optimum 
solution. 


2.3.2 Method of Distance Functions 


In this method, the scalarization is achieved by using a demand-level vector y which 
has to be specified by the decision maker. The single objective function derived from 
multiple objectives is as follows: 







t=l 


1 < r < oo, X € X. 


(2.4) 


Usually an Euclidean metric r = 2 is chosen, with y as individual optima of objectives 
(Hans, 1988). It is important to note that the solution obtained by solving above 
equation depends on the chosen demand-level vector. Arbitrary selection of a demand 
level may be highly undesirable. This is because a wrong demand level will lead to 
a non Pareto-optimal solution. As the solution is not guaranteed, the decision maker 
must have a thorough knowledge of individual optimum of each objective prior to 
the selection of demand level. In a way this method works as a goal programming 
technique imposing a goal vector, y (demand level), on the given objectives. This 
method is similar to method of objective weighting with only difference in that in 
this method the goal for each objective function is required to be known and in the 
previous method the relative importance of each objective is required to be known. 
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2.3.3 Min-Max Formulation 

This method is different in principle than the above two methods. This method 
attempts to minimize the relative deviations of the single objective functions from 
individual optimum. That is, it tries to minimize the objective conflict. For a mini- 
mization problem, the corresponding min-max problem is formulated as follows: 

minimize .F(x) = max {Zj(x)], ; = 1,2, ...,N, (2.5) 

where x € X and Zj{x) is calculated for nonnegative target optimal value /j > 0 as 
follows: 

Z,(x) = ^^-^, j = l,2,...,N. (2.6) 

Jj 

This method can yield best possible compromise solution when objectives wdth equal 
priority are required to be optimized. However, priority of each objective can be 
varied by introducing dimension-less weights in the formulation. This can also be 
modified as a goal programming technique by introducing a demand-level vector in 
the formulation. 

2.4 Drawbacks of Classical Methods 

In all above methods, multiple objectives are combined to form one objective by using 
some knowledge of the problem being solved. The optimization of the single objec- 
tive may guarantee a Pareto-opti'mal solution but results in single point solution. In 
real world situations decision makers need different alternatives in decision making. 
Moreover, if some of the objectives are noisy or have discontinuous variable space 
these methods may not work effectively. Some of these methods are also expensive 
as they require individual optimum prior to vector optimization. The most profound 
drawback of these algorithms is their sensitivity towards weights or demand-levels. 
The decision maker must have a thorough knowledge of the priority of each objective 
before forming the single objective from a set of objectives. The obtained solution 
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depends on the underlying weight- vector or demand-level. Thus, for different situ- 
ations, different weight- vectors need to bo used and the same problem needs to be 
solved a number of times. This aspect is illustrated by considering a simple example. 

A simple two-objective problem Fl of one variable is considered to illustrate the 
concept of multiple Pareto-optimality. This problem was used for the same purpose 
by V'^incent and Grantham (1981) and subsequently by Schaffer (1984). The problem 
has two objectives and is shown in figure 2.1 and figure 2.2 : 

Minimize /n = , 

Minimize /12 = — ‘Ff ■ (2-7) 

From the plot showing the performance space, it is clear that the Pareto-optimal 
solutions constitute all x varying from 0 to 2. The solution x = 0 is optimum with 
respect to /u but not so good with respect to fn and the solution x = 2 is optimum 
with respect to function fn and not so good with respect to /n. Any other point 
in between is a compromise to the above two functions and is a Pareto-optimum 
point. But the solution x = 3, for example, is not a Pareto-optimum point since this 
point is not better than the solution x = 2 with respect to either function. Among the 
Pareto-optimal points, the decisi&n maker may want to prefer one point over the other 
depending on the demanding situation, but before taking any decision, he or she may 
want to know the possible Pareto-optimal solutions. The traditional methods cannot 
find multiple Pareto-optimal solutions simultaneously. For example, with all above 
methods and with equal priority to botli functions having a weight vector (0. 5,0.5), 
and demand-levels as individual optima, the obtained solution is x* = 1 . A weight 
vector (1,0) results in a scalarized objective as fu. This gives a solution w'hich is 
very good in fu but not so in / 12 , or the solution x* = 0. Similarly weight vector 
(0,1) produce nainimum of fu or x’ = 2. Any point in the range 0 < x < 2 may be 
a valid compromise and can be obtained with a particular choice of a weight vector. 
Thus, in order to obtain a particular solution the user has to know the corresponding 
weight vector, w'hich is a difficult problem by itself. Another problem of using classical 
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methods is that oftentimes some objectives may involve uncertainities. If the objective 
functions are not deterministic, the fixation of a weight vector or a demand-level 
may become even more difficult. This discussion suggests that the classical methods 
to handle multiobjective optimization problems are inadequate and inconvenient to 
use. A more realistic method would be one that can find multiple Pareto-optimal 
solutions simultaneously so that users or decision makers may be able to choose the 
most appropriate solution for the current situation. Real-world and major decisions 
require higher-level (managerial or higher) intervention. Designers have no right to 
decide whether to build a car like Maruti or Ambassador. It is best for the designers 
to present as many compromise solutions as possible to management and help them 
decide. The knowledge of many Pareto-optimal solutions is also useful for later use, 
particularly when the current situation has changed and a new solution is required 
to be implemented. Since genetic algorithms deal with a population of points instead 
of one point, multiple Pareto-optimal solutions can be captured in the population in 
a single run. 

2.5 Summary 

In a multiobjective optimization problem, solution exists in the form of a set of points 
known as Pareto-optimal solutions or nondominated points. A designer or decision 
maker will be interested in a set of solutions, instead of a single point. In trying 
to solve these problems, most traditional methods scalarize the objective vector in 
to a single objective. This alw'ays results in a single point solution to the problem. 
They also require information about individual optima of all objectives, prior to the 
scalarization. Another serious disadvajitage is that, methods like distance functions 
do not guarantee a Pareto-optimum. Since genetic algorithms work with a population 
of points and posses implicit parallelism, they show some promise in finding multiple 
Pareto-optimal solutions quickly in a single run. 

The following chapter introduces genetic algorithms in function optimization. 
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Subsequent chapters describe modifications to this simple genetic algorithms to solve 
multiobjective optimization problems. 



Chapter 3 

Introduction to Genetic 
Algorithms 


This chapter presents the fundamentals of genetic algorithms in function optimization. 
Genetic algorithms (GAs) are artificial search techniques based on natural law of 
population genetics. According to Goldberg (1989), they combine the Darwinian 
survival of the fittest and a stochastic information exchange procedure to form a 
robust search technique. The following section presents the mechanics of genetic 
algorithms. 


3.1 Mechanics of Genetic Algorithms 

In an artificial genetic search the coordinates of the search space (also known as 
parameter set) are coded into a finite length of string. A point in the space is rep- 
resented by a string and the decoded values of the string’s contents will correspond 
to its coordinates. This type of coding enables GA to simulate the characteristics of 
natural chromosome. Usually, in most cases, binary coding is adopted, even though 
this is not absolutely necessary. These coded strings are similar to the chromosomes 
in biological systems. In natural genetics the genes in chromosomes aflFect the phys- 
ical qualities of an individual and also influence the characteristics of an offspring. 
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The gene values, known as alleles, completely describe an organism of an individual. 
Similarly in GAs, the binary string’s T’ or ‘0’ values describe a point’s coordinates. In 
GA terminology, coded strings are called chromosomes and each point an individual. 
The chromosome’s ‘1’ or ‘0’ value is known as an allele. An individual’s objective 
function value is known as fitness value or simply fitness. 

GAs are population based search techniques. They process a number of points, 
collectively known as population. In many GAs, the population size is kept constant. 
Stochastic methods are used to generate unbiased initial population in the search 
space. Unlike the traditional methods, which apply deterministic transition rules to 
update a point, GAs utilize probabilistic transition rules in each iterative step. Such 
discrete time step required to process and update an old population is known as 
generation. In each generation the population is processed by three main operators, 
which emulate the selection, mating and mutation of natural genetics. A GA which 
is composed of these three operators is popularly known as simple genetic algorithm, 
SGA. SGA’s three important operators are : 

• Reproduction, 

• Crossover, and 

• Mutation. 

Reproduction or selection is the first operator in a GA. This operator makes copies 
of better individuals present in the population. Such individuals are identified by their 
fitness values. For example, in a maximization problem, good points are those points 
which have a fitness value above the average fitness of population and the best among 
them is the one which has the highest fitness. This selection process allows high fitness 
individuals to survive and reproduce, and low fitness strings to die. This is nothing 
but a simulated version of Darwinian survival of the fittest. Reproduction is the only 
operator in GA that processes individuals according to their fitness values. 
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Several selection schemes are in use today, and a detailed comparative analysis is 
made in Goldberg and Deb (1991). One method of selection is proportionate selection. 
This method simulates a spinning roulette wheel with slots sized according to the 
fitness values. In a maximization problem, using this method, the probability of 
being selected for copying is /i/Hj/,, where /, is the fitness of string f, and fj 
is the sum of all fitnesses. The expected number of copies of an f-th string is found 
by /.//, where / is the average fitness of the population. A modified version of this 
method is knowm as stochastic remainder proportionate selection. In this method 
the number of copies are made according to the integer and fractional parts of the 
expected count (/,/ /). This method minimizes the chance of random (blind) selection 
of some individuals, w'hich may occur in a roulette wheel simulation. These methods 
can be applied only to maximization problems with positive fitness values. In order 
to minimize a function, the function has to be modified such that the maximum 
obtained will be the true minimum of actual function (duality principle). Several 
scaling methods have been suggested elsewhere (Goldberg, 1989) to handle negative 
function values. 

Tournament selection is another selection process which can be applied to mini- 
mization as well as maximization problems without any restraint on the sign of fitness 
values. This method selects the best individual from a group of randomly chosen in- 
dividuals. This process is carried until the mating pool is completely filled. The 
number of individuals considered for selection of an individual is known as tourna- 
ment size. A tournament size of 2, known as binary tournament, is used in most of 
GA applications. 

Crossover is the second operator in an SGA. This is a two stage operator. In the 
first stage, two strings are picked up at random from the newly reproduced strings in 
the mating pool and a cross site is selected, also at random, over the string length. In 
the second stage, two new strings (offsprings) are produced from the mating strings 
(parents), by swapping their string segments on one side of the cross site. For example, 
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in Ccise of a two 6-bit binary coded strings, and the mating occurs as shown 
below. 


Si 


S2 


1 0 

1 0 


1 

0 


1 00 


o""! T 


\ 

\ Cross site 


The cross site is as shown. After mating the two new strings, s[ and s^, will be 


s\ = 


1 0 1 I 0 1 1 


sf, = 


10 0 10 0 


The crossover operator is an artificial version of natural chromosome exchange in a 
genetic mating. Reproduction and crossover are the major operators in a GA. While 
the reproduction copies the best strings in the population, crossover produces new 
strings by exchanging some genetic material (I’s or O’s in a binary string) between 
them. Together they search for new high-performance individuals. The power of ge- 
netic search lies in the selection of high-quality strings and the structural information 
exchange between them. The total number of strings participated in the mating can 
be controlled by specifying crossover probability, pc- This parameter is the ratio of 
total number of strings selected for mating and the population size. 

Mutation plays a secondary role in a GA. It helps to recover the loss of some 
potentially useful genetic material which might have been lost or absent in a genetic 
search. Mutation is the occasional random alteration of an allele’s value (changing a 
1 to a 0 and vice versa). The mutation probability, pmt is kept very low as it disrupts 
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a string. Goldberg (1989) describes it as an insurance policy against premature loss 

of important notions. This process is illustrated below. 

I — I Mutation 

1010 11 > 1110 11 

A flow' chart of a simple genetic algorithm is shown in figure 3.1. The next section 
presents some mathematical fundamentals of a genetic search. 

3.2 Mathematical Fundamentals - The Schema 
Theorem 

A GA actually discretizes the variable space by adopting a coding method. By pro- 
cessing certain strings which are similar in a w'ay, it actually process a region. Con- 
sider as an example a one variable problem with 6-bit binary coding and the following 
strings in the population. 


Si = 

110101 

S2 = 

001100 

•S 3 = 

100011 

S4 = 

011110 


There are several similarities among these strings. Holland (1975) defined a new 
entity, known as schema {schemata^ plural), as a similarity template describing a 
subset of strings with similarities at certain string positions. The above strings have 
several schemata in common. By introducing a “don’t care” symbol, which can 
represent either a 1 or a 0, a schema can be expressed in terms of {0, 1, *}. Three 
schemata are shown below. 


Hi = 

H2 = 

Hz = 


1 * 0 ♦ * 1 
0 * * ♦ * ♦ 
***10* 
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Figure 3.1: A flow chart of simple genetic algorithm, SGA. 
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Strings si and 53 belong to S2 and S4 belong to and Si and belong to Hz- 
In this example, total number of schemata available will be 3® while the total number 
of strings are 2® (string length is 6). One can see that a schema represents a region 
in the variable space. In this example, (0 * ♦ * * *) and (1 * * * =1= represent two 
equal portions of entire variable space. Supposing the optimum doesn’t lie in (0 * * 
* * *) region, the strings belonging to this schema will not survive compared to the 
strings of (1 ** + **). The GA will soon recognize this fact and the population of 
strings belonging to (1 * * * * *) schema will increase in coming generations. This 
effect can be explained, mathematically, by considering two important properties of 
a schema - order of a schema, o{H), and its defining length, 6{H). The order of a 
schema is the number of fixed bits or positions (I’s or O’s) present in the template 
and its defining length is defined as the distance between two extreme fixed bits. In 
case of the three schemata Hi , H 2 and Hz' 

o{Hi) = 3, 0(^2) = l.o{Hz) = 2, 

8{Hi) = b,6{H2) = ^,8{Hz) = 1. 

Denoting the population of strings belonging to a schema H, at generation t, as 
m{H, t), the fitness of the schema, f{H), can be defined as : 

12s, €H fi^i 

m{H, t) 

During the selection process a schema will survive if its fitness is greater than the 
average fitness of population. In other words, the population of a schema will increase 
or decrease proportional to the factor f{H)/f. The disruption of a schema during 
crossover depends upon its length, S{H), and during mutation on its order, o{H). 
Therefore, the expected number of strings of a particular schema at generation t + 1 
can be expressed as (Goldberg, 1989) : 

m{H,t+l) > m{H,t)^ I - - p,no{H) , 
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where pc and pm are the crossover and mutation probabilities, and I is the string 
length. The above expression is a lower bound on the expected count of schema H. 
For a short, low ordier, highly fit schema, the quantity. 


J(H) 


-pmO{H) 




will be always greater than 1. Therefore, such types of schemata will receive expo- 
nentially increasing number of copies in future generations. This theorem is known as 
Schema Theorem or The Fundamental Theorem of Genetic Algorithms. The schemata 
with above qualities are known as building blocks. By processing population of strings 
of size n, and allocating increasing number of copies to building blocks, GA implic- 
itly process schemata without any special accounting or memory. Holland (1975) 
named this special ability of GA as implicit parallelism. As the generations pro- 
ceed, the low order building blocks produce higher order, highly fit building blocks, 
eventually leading to optimal or near optimal strings. 


3.3 Advantages of GAs 

Most of the traditional algorithms are point based techniques and use deterministic 
transition rules to update a point. These can be classified as direct and descent meth- 
ods (Rao, 1991). Direct search methods require objective function values only, and 
update a point using local exploration. Descent methods are gradient based tech- 
niques. They require first and often higher order differentials of objective function. 
Both these methods have a tendenc}^ to converge, prematurely, to a local peak. These 
methods are suitable only to a class of problems. For discontinuous or continu- 
ous functions gradients cannot be found, which limits their application. In view of 
these drawbacks, we can draw some important differences between GAs and their 
traditional counterparts. They differ in four ways (Goldberg, 1989) : 


1. GAs work with a coded parameter set. 
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2. GAs are population based search techniques. 

3. GAs require only the objective function values. 

4. GAs use probabilistic transition rules in updating the population. 

The coding in GAs finely discretizes the variable space. This type of discretizing 
enables GAs to handle discontinuous as well as continuous functions. This helps GAs 
to handle a wide variety of problems. The genetic search starts from a population 
of random points, uniformly distributed over the variable space. This property of 
population based search helps enhanced GAs (Deb, 1993) to present a set of solutions 
instead of a single point. By processing schemata, GAs implicitly conducts a parallel 
search, which makes it to find a global solution. Reproduction is the only operator in 
GAs that uses the objective function and it does not require any auxiliary information 
such as gradients. G.As are “blind”, because they operate as a black box taking input 
in the form of objective function values and giving output in the form of highly fit 
individuals. The unbiased probabilistic rules can update a population, no matter 
how the function varies. This permits them to be applied to a wide class of problems 
with higher efficiency than their traditional counter parts. This ability, known as 
robustness^ promises a bright future for GAs in function optimization. 


3.4 Summary 

Genetic search resembles the mechanics of natural genetics. GAs process a population 
of points which are coded as strings so as to simulate the characteristics of natural 
chromosomes. A simple GA is composed of three operators - reproduction, crossover, 
and mutation. Reproduction copies the best strings while crossover exchanges string 
segments of these copies. Together they search for new high-performance notions. 
Mutation is a secondary operator, which tries to recover the lost or absent genetic 
material by occasional alteration of an allele. By processing similar strings, GA 
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process a number of schemata, which represent regions in the variable space. It is ar- 
gued that, GAs allocate exponentially increasing number of copies to short, low order, 
highly fit schemata, known as building blocks. As generations proceed, these building 
blocks form higher order, high-quality schemata, which results in the narrowing of the 
search region. Finally, this process leads to an optimal or a near optimal string. GA’s 
implicit parallelism, due to its stochastic operators and population of individuals, in- 
creases the probability of finding the global optimum. This special ability makes it a 
robust tool in solving a wide range of problems. 

The next chapter presents an early extension to this SGA to solve multiobjective 
optimization problems. 



Chapter 4 


Vector Evaluated Genetic 
Algorithm 


As early as in 1967, Rosenberg suggested, but did not simulate, a genetic search to 
the simulation of the genetics and chemistry of a population of single-celled oi'ganisms 
with multiple properties or objectives (Rosenberg, 1967). Rosenberg performed selec- 
tion and mating according to an antifitness function, /, = Y.j {^3 ~ where /, is 
the i-th properity, Zj is chemical concenti'ation and Xj is desired concentration [goal). 
The sum is taken over all chemicals present in the i-th properity. The inverse of /, 
values were considered in reproduction and mating. Rosenberg experimented with a 
single properity (z = 1) and suggested an extension of his work as an application to 
multiobjective problems. 

First practical algorithm, called Vector Evaluated Genetic Algorithm (VEGA), 
was developed by J. D. Schaffer in 1984 (Schaffer, 1984). The following section 
presents this algorithm. 
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4.1 Schaffer’s VEGA 


Schaffer modified simple tripartite genetic algorithm by dividing the population into 
equal subpopulations for each objective and selecting from each pool separately ac- 
cording to each objective. He modified J. J. Grefenstette’s GENESIS program (Schaf- 
fer, 1984) by creating a loop around traditional selection procedure, so that it was 
repeated for each individual reproduction. Then entire population is thoroughly shuf- 
fled to apply mating and crossover operators. This is performed to achieve the mat- 
ing of individuals of different subpopulation groups. Schaffer also incorporated a 
procedure to identify the nondominated individuals in order to analyze the VEGA’s 
performance. This algorithm is shown in figure 4.1. 

One advantage of this algorithm is that, it insures the survival of any individual 
that performs above average in any objective. Schaffer’s intention was to produce 
Pareto-optimal offsprings by mating above average strings of different pools. Al- 
though this procedure seems to be logical from a biological point of view, there is 
every possibility of a mating between strings of same pool. This cannot be avoided 
because of the random processes invoh'ed such as mate selection and shuffling. This 
algorithm worked efficiently for some generations but later suffered from a serious 
drawback which is its potential bias against middling or utopian individuals. The in- 
dividual selection of specialists from each subpopulation resulted in speciatio'n in the 
population. Outcome of this effect is the convergence of entire population towards in- 
dividual optimum regions after a large number of generations. Being a decision maker, 
we may not like to have any bias against such utopian individuals, rather we may 
want to find any nondominated points. Schaffer tried to minimize this speciation by 
developing two heuristics — the nondominated selection heuristic (a wealth redistri- 
bution scheme), and the mate selection heuristic (a cross breeding scheme) (Schaffer, 
1984). These two heuristics are briefly discussed in the fallowing subsections. 




Figure 4.1: Schaffer’s vector evaluated genetic algorithm, VEGA 
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4.1.1 Nondominated Selection Heuristic 

In this heuristic Schaffer attempted to give some preference for nondominated in- 
dividuals during the selection process. He felt that by selecting high performance 
individuals from each pool, some points with good performance in all objectives, but 
without extremely good in any, might not survive. This resulted in speciation in the 
population. The nondominated selection heuristic was aimed at minimizing this spe- 
ciation. In this heuristic, dominated individuals are penalized by subtracting a small 
fixed penalty from their scaled fitness. Then the sum of the penalties was divided 
among the nondominated individuals and was added to their fitness. But this algo- 
rithm failed when the population has very few nondominated individuals, resulting 
a large fitness value for those few nondominated points, eventually leading to a high 
selection pressure. For this reason, Schaffer had to drop this method though it was 
better than simple VEG.A,. 

4.1.2 Mate Selection Heuristic 

The mate selection heuristic was intended to promote the cross breeding of specialists 
from different subgroups. This was implemented by selecting an individual, as a mate 
to a randomly selected individual, which has the maximum Eucledean distance in the 
performance space from its mate. But it failed to prevent the participation of poorer 
individuals in the mate selection. This is because of random selection of the first 
mate and the possibility of a large Euclidean distance between a champion and a 
mediocre. A modified version of mate selection was also considered using a measure 
known as “improvement distance” instead of Eucledean distance. Schaffer defined 
this distance ais the sum of all positive differences between a mate’s objectives and 
its proposed mate’s objectives (for minimization only). The first mate is selected, as 
usual, from the mating pool at random. Schaffer found this method better than the 
first version, but still worse than the simple VEGA without it. Schaffer concluded 
that the random mate selection is far superior than this heuristic. 
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4.2 Simulation Results of Problem FI 


A simple VEGA is implemented in ‘C’ language. This code is used to test VEGA’s 
ability in finding nondominated points. This program is used to solve test problem 
FI, introduced in chapter 2. The same problem was also used by Schaffer to test the 
capabilities of VEGA. The results obtained, as a part of this thesis, are found to be 
similar to Schaffer’s results (Schaffer, 1984). 

In all simulations, the \’EGA parameters used in the experiments are as follows: 


Maximum generation : 500 

Population size : 100 

String length (binary code) : 32 

Probability of crossover : 1.0 

Probability of mutation : 0.0 

Tournament size : 2 


The parameters are held constant across all runs. To investigate the effect of 
VEGA alone, mutation probability is kept zero. Unbiased initial population is gener- 
ated randomly spreading over entire variable space in consideration. Initial range for 
the design variable, x, used in simulations is [—10, 10], but the nondominated region 
is only [0,2]. The population drift is shown in figures 4.2 through 4.5. These figures 
are drawm in the performance space. 

The initial population is shown in figure 4.2. At generation 10, VEGA’s popula- 
tion moved towards Pareto-optimal front (figure 4.2). But at generation 100, some 
subpools are formed in the population. These clusters moved further towards in- 
dividual optima with generation number. At generation 500, VEGA’s population 
completely converged to three sub-regions which are close to individual optima (fig- 
ure 4.5). These subpools are nothing but species formed in the population. These 
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results clearly show the VEGA’s failure in maintaining stable populations at all non- 
dominated points. This experiment reiterates VEGA’s lack of control over the spe- 
ciation in the population. One method to increase uniform distribution of points is 
through a nondominated sorting procedure in conjunction with a sharing technique, 
as suggested by Goldberg (1989). That algorithm is discussed in the following chapter. 

4.3 Summary 

Schaffer’s VEGA was based on the principle that mating between two best strings 
with respect to different objectives, might produce a compromising offspring. To im- 
plement this, he modified SGA by dividing the population into equal subpools, as 
many as the number of objectives, and selecting from each pool according to an ob- 
jective. Thi.s algorithm worked efficiently for some generations but later suffered from 
a serious drawback which is its potential bias against middling or utopian individuals. 
As a result, the population tended to drift towards individual optima of objectives. 
To minimize this drift, Schaffer considered two heuristics. The first one, he called 
nondominated selection heuristic - a wealth redistribution scheme - was dropped as it 
offered the possibility of a high selection pressure. Second method, the mate selection 
heuristic, was intended to promote the cross breeding of above average individuals 
of different pools. Schaffer’s experiments revealed that simple VEGA’s random mate 
selection was far better than this heuristic. Simulation results of problem FI. have 
showed that VEGA’s population distribution is biased towards individual optima. 
This result also show VEGA’s inability in distributing its population over Pareto- 
optimal region. 

VEGA’s failure in keeping stable subpopulations at some middling regions prompted 
researchers to come up with new suggestions. One such suggestion, by David Gold- 
berg, is pursued in the next chapter. 



Chapter 5 


Nondominated Sorting 


The idea behind the nondominated sorting procedure is that a ranking selection 
method is used to emphasize good points and a niche method is used to maintain 
stable subpopulations of good points. This algorithm is developed based on this con- 
cept. Since the algorithm is based on nondominated sorting procedure, this algorithm 
is named as nondominated sorting genetic algorithm, NSGA. 


5.1 Nondominated Sorting Genetic Algorithm 

NSGA varies from simple genetic algorithm only in the way the selection operator 
works. The crossover and mutation operators remain as usual. Before the selection 
is performed, the population is ranked on the basis of nondomination described in 
chapter 2. The nondominated individuals present in the population are first iden- 
tified from the current population. All these individuals are assumed to contribute 
the first nondominated front in the population and assigned a dummy fitness value 
proportional to the population size. This dummy fitness is intended to give equal 
reproductive potential for all these nondominated individuals. In order to maintain 
diversity in the population, these classified individuals are shared with their dummy 
fitness values (fitness sharing is a way of finding and maintaining multiple optimal 
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Table 5.1: An illustration of nondominated sorting procedure. 


Individual 

X 

Fitness 1 

Fitness 2 
(x - 2)2 

Rank / 
Front 

Dummy fitness 
before sharing 

Dummy fitness 
after sharing 

1 

-1.5 

2.25 

12.25 

2 



2 

0.7 


1.69 

1 



3 

4.2 

17.64 

4.84 

2 



4 




1 


3.43 

5 

1.75 



1 


3.43 

G 



25.0 

3 




solutions in a simple GA (Goldberg and Richardson, 1987; Deb, 1989). Then these 
individuals are ignored temporarily to process the rest of population in the same way 
to identify individuals for the second front. These new set of points are then assigned 
a new dummy fitness value which is kept smaller than the minimum shared dummy 
fitness of the previous front. This process is continued until the entire population is 
classified into several fronts. To illustrate the sorting procedure better, the problem 
FI is considered again. For example, consider a population of 6 points shown in ta- 
ble 5.1. Each individual has two fitness values. First fitness corresponds to the first 
objective, /n = and the second fitness to the second objective, /12 = (x — 2)^. 
Using equation 2.2, these individuals are ranked as shown. Since both fitness values, 
fii and / 12 , of the second individual are less than that of the first individual, second 
individual dominates the first individual. This way first, third, and sixth individuals 
are classified as dominated points. 

This sorting will produce the first batch of nondominated points, second, fourth. 
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and fifth individuals, as they do not dominate each other. These individuals belong 
to the first front and assigned equal dummy fitness value, say 6.0. Once the first front 
is found, all points in this front are ignored temporarily, to process the rest of the 
population in the same way. Thus we are left with first, third, and sixth individuals. 
Among these points, first and third individuals, classify the second front and sixth 
point classify the third front. In each front, dummy fitness is assigned in a way so that 
a latter front is inferior to a former front. For example, to first and third individuals, 
a fitness of 3.00 each and to sixth a fitness of 2.00 may be assigned. In actual practice, 
the dummy fitness values depend on the sharing of the individuals, an aspect which 
is discussed in the next section. These newly assigned values are kept slightly less 
than the minimum shared dummy fitness of the previous front. This process helps to 
set priorities on different individuals. 


The population is then reproduced according to dummy fitness values. A stochas- 
tic remainder proportionate selection is used in this study. Since individuals in the 
first front has the maximum fitness value, they always get more copies than the rest of 
population. This was intended to search for nondominated regions or Pareto-optimal 
fronts. This results in quick convergence of the population towards nondominated 
regions, and sharing helps to distribute it over this region. In reality, the exact non- 
dominated region is the one that is obtained after comparing all the points in feasible 
domain. If a point is locally dominated, it is also globally dominated. But the con- 
verse is not true. In each generation, NSGA finds locally nondominated points only. 
However, if there exists any isolated globally nondominated point NSGA insures its 
survival. This is because any such individual is likely to have highest possible dummy 
fitness. The power of NSGA lies in the successful transformation of a multiobjec- 
tive problem, no matter how many objectives are there, to a single function problem 
without losing the concept of vector optimization. By selecting nondominated points, 
NSGA is actually processing those schemata that represent Pareto-optimal regions. 
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Figure 5.1: Nondominated sorting genetic algorithm, NSGA. 
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Therefore, the building blocks for NSGA will be those schemata that represent glob- 
ally nondominated individuals. Figure 5.1 shows a flow chart of this algorithm. It is 
interesting to note that both minimization and maximization problems can be handled 
by this algorithm. It requires a simple changing of selection process of nondominated 
individuals as stated in chapter 2. 


5.2 Fitness Sharing 

In dealing with multimodal problems, simple GAs converge to one optimum and 
cannot converge to man}" alternatives. Whether GAs will converge to this or that op- 
timum is usually unpredictable. This problem with finite populations is known as the 
genetic drift. .Since every nondominated individual in NSGA will be assigned equal 
dummy fitness, convergence of population to a solution is completely unpredictable. 
A simple nondominated sorting procedure cannot control this type of genetic drift. In 
fact, population must be distributed in order to find as many Pareto-optimal points 
as possible. Simple GAs are not robust enough to find multiple peaks in a single 
run. But GAs can be used to form stable subpopulations of individuals by artificially 
forming niches corresponding to each optimum. 

In nature, niche can be viewed as an organism’s job or role in an environment 
and species as a group of organisms with common characteristics. In artificial ge- 
netic search multiple peaks or function subdomains correspond to niches, and strings 
serving those domains to species. By artificially forming peaks in the search space, 
strings can be allocated to each peak proportional to its magnitude. 

Goldberg and Richardson (1987) developed a niching technique by defining a func- 
tion Sh{dij) as a function of distance metric between z-th and j-th individuals 
as: 

Sh{d,j) = p “ ^ (5 

[ 0 , otherwise. 

The purpose of sharing is to degrade an individual’s fitness value by dividing it by 
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the accumulated number of shares as follows: 

/(Xi) 


/.(X.) = 


T.U Skidij)- 


(5.2) 


where P is the po])ulation size. If there are more number of individuals around an 
alternative, the fitness of that individual (and those around it) will be degraded more. 
This helps to keep diversity in the population and delay convergence of individuals to 
a particular alternative. The sharing parameter is used to control the extent of 

sharing. When the distance-metric (d,j) is measured in decoded parametric space, it is 
called phenotypic sharing. The calculation of the distance-metric and corresponding 
sharing parameter value is described elsewhere (Deb, 1989). 

For a p-dimensional decision-vector, the distance-metric is calculated as follows: 


dij = 


1 




(5.3) 


/:=! 


where x,- = (xi,.. X 2 ,, and Xj = {xij,a: 2 ,i 7 . ■ ■ are decoded vectors 

of t-th and j-th strings. To induce q number of niches over entire parametric space, 
the parameter is calculated from the following equation (Deb, 1989;Deb and 

Goldberg, 1989) 

{^k.max ~ ^k,min) 


‘^share 




The above equation has been formed assuming each niche as a p-dimensional hyper- 
sphere of radius o'share’ sphere encloses ^ of the hypervolume of the 

whole space. Equations 5.3 and 5.4 are used in NSGA to calculate and In 

case of parameter set with unequal bounds, a normalized distance metric can be 


dij — 


-3:k,j}/ixk jTTltZX ^k,min)} t 

\ k=i 


(5.5) 


and fgiiare corresponding to this normalized distance metric will be 

1 


^shaxe 


2q^/P ■ 


(5.6) 
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Consider the example population shown in table 5.1. If = 1.0 is chosen, 

then second individual do not share with fourth or fifth individuals, because the 
absolute difference in decoded parameter space between second and fourth fifth are 
not less than 1.0. Thus IIj= 2 , 4,5 ■5’A(d2j) = 1.0 and fs{T 2 ) = 6/1 = 6.0. On the other 
hand, fourth individual shares with fifth individual and Sh{d 45 ) = ^1 — ] = 

0.75. Thus shared fitness of fourth individual is /^{x^) = 6/(1 + 0.75) = 3.429. 
Similarly, the shared fitness for fifth individual is /^(xs) = 6/(1 + 0.75) = 3.429. 
Since, the minimum shared fitness in the first front is 3.429, we assign dummy fitness 
values of all individuals in the second front equal to 3.0 (sa}^) . Clearly, the two 
individuals in this front do not share with each other. Thus their shared fitness is 
same as their dummy fitness values : fs{xi) = fs{xz) = 3.0. Since, there is only one 
individual in the third front, the shared fitness is fsixe) = 2.0. 

Individuals in each front are shared separately so as to maintain diversity of so- 
lutions in each front. Since individuals in the first front has greater dummy fitness 
value, the population quickly converges towards the first front. Then sharing controls 
number of individuals around a point, thereby distributing the population over the 
entire front. This helps to avoid convergence towards individual champions. The 
degree of distribution can be controlled by crgj^gj.g parameter, which depends on the 
desired number of Pareto-optimal points. 

The distribution powers of NSGA can be tested by considering the problem Fl. 
The following section presents the simulation results of Fl obtained using NSGA. 


5.3 Simulation results of Problem Fl 

This problem was introduced in chapter 2, and VEGA’s results are presented in 
chapter 4. In all simulations for this problem, the NSGA parameters used in the 

I 

experiments are as follows: 
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Maximum generation : 500 

Population size : 100 

String length (binary code) : 32 

Probability of crossover : 1.0 

Probability of mutation : 0.0 

•^share ’ 


The parameters are held constant across all runs. To make the comparison fair, 
the initial population used for NSGA is same as that generated for VEGA. This is 
shown in figure 5.2. The population drift is shown in figures 5.2 through 5.5, drawn 
in the performance space. 

As mentioned earlier, the initial population (at generation 0) is exactly same for 
both VEGA and NSGA. At generation 10, like VEGA, NSG.'^’s population converged 
towards the nondominated region. At generation 100 (figure 5.4), the difference in 
distribution is clear, NSGA’s population is distributed uniformly, while VEGA formed 
some subpools of strings (figure 4.4). Unlike VEGA, NSGA continued to maintain this 
distributed population. This can be observed in figure 5.5,which shows population 
at generation 500. This figure also shows the ability of NSGA in distributing the 
population uniformly and maintaining it till generation 500. 

In view of these results, some comparisons can be drawn between VEGA and 
NSGA. These are discussed in the following section. 


5.4 Comparisons between VEGA and NSGA 

VEGA’s search is not directed towards nondominated regions. This is because its 
selection is biased towards individual optima. In other words, it is incapable of 
recognizing the building blocks required for multiobjective optimization. In case 
of NSGA, the nondominated individuals are identified before the selection process 
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begins. Also, NSGA ranks all individuals on the basis of nondomination. This is 
important, because even the dominated points can be ranked (classified as fronts) 
using this concept. This process enables NSGA to set preferences on respective strings 
of different fronts. It is easy to visualize that in every classified front there will always 
be on<' or more than one individual. Every member of such group must have equal 
chance of reproducing (survival probability). In fact, the inability to provide such 
equal priority is the main reason for VEGA’s failure. At the same time, NSGA 
assigns equal dummy fitness to all such members, giving them equal reproductive 
strength. This process not only helps to avoid the bias present in VEGA, but also 
enables to process the required building blocks. For example, consider the problem FI 
(figures 2.1 and 2.2) presented in chapter 2. In this problem the nondominated or 
Pareto-optimal region is 0 < x < 2 . Assuming the variable span as — 8 < x < 8 and 
a 4-bit binary coding in the simulation, the nondominated region is represented by 
strings varying from 1 0 0 0 to 1 0 1 0 (approximately). Thus, this region is represented 
by schema (10**). This becomes the building block for NSGA. Some times the initial 
population may not contain any true nondominated points. But, such situations 
also occur in single function optimization, where SGA’s initial population may not 
have any representation of a building block. Crossover helps in these situations, by 
creating new strings that are likely to represent Pareto-optimal regions. This way 
NSGA searches for nondominated regions. 

Another drawback of VEGA is its lack of control over speciation. Schaffer’s two 
heuristics, nondominated selection and mate selection heuristics, failed to produce 
desired effects. NSGA employs a fitness sharing method, a niche and speciation 
technique, to control its population in forming subpools in the search space. It uses 
phenotypic sharing, which discourages many occupants in a species by degrading their 
dummy fitness values. Another disadvantage of VEGA is its population size. As the 
number of objectives increase, the population size has to be increased to minimize 
the bias of individual selection. NSGA is not affected by the population size and the 
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numlxT of objorf ivc.s. Only tlio string longtli and the required precision effect the size 
of ptjpulation. 

Other advantages of NSGA include its flexibility in handling multiobjective prob- 
lems of minimization or maximization or both. Sharing does not effect the the actual 
function values as it changes dummy fitness values only. This way actual function 
values are pre.served. Using proper fitness scaling methods on dummy fitness values 
selection pressure can be controlled. This may expedite NSGA’s convergence towards 
Pareto-optimal solutions. 


5.5 Summary 

Nondoniinated sorting is the process of identifying nondominated individuals in the 
population and setting priorities on them. NSGA employs this procedure and a fitness 
sharing method to solve multiobjective optimization problems. In each generation, 
NSGA identifies nondominated points in groups. First group individuals are assigned 
a dummy fitness value proportional to the population size. Then these individuals are 
shared over dummy fitness. The succeeding groups are identified, in the same way, 
temporarily ignoring the previously processed groups. They will receive a dummy fit- 
ness value which is less than the minimum shared dummy fitness of its previous group. 
After assigning this fitness, each group is shared before sorting the next group. After 
the classification of entire population in this way, strings are copied according to their 
dummy fitness values. The rest of the algorithm, crossover and mutation, is similar to 
that of a simple GA. The power of NSGA lies in the identification of nondominated 
points and setting preferences on them. This helps NSGA to process necessary build- 
ing blocks which represent Pareto-optimal regions. The major differences between 
VEGA and NSGA are the selection process and the niche and speciation technique. 
VEGA’s selection is biased and Schaffer’s heuristics failed to control the speciation. 
NSGA overcame both the difficulties using nondominated sorting and fitness sharing 
technique. 
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The next chapter presents the sinrinlation results of NSGA and VEGA on two 
more test functions. 



Chapter 6 


Comparative Analysis of NSGA 
and VEGA 


In this chapter, NSGA and VEGA are applied on three test problems previously 
used by Schaffer (19S1) and others (Vincent and Grantham, 1981; Chankong and 
Haimes, 1983). The comparison is made based on the population movement and a 
chi-square-like distribution measure. 

6.1 Test problems 

The first two problems considered are of two single variable objectives and the third 
problem is a set of two two-parameter functions. Although some functions, other 
than the three functions, are used to validate the code, they are not discussed in this 
thesis. 


Problem FI : Two smooth, single- variable, unimodal objec- 
tives: 

This problem was already presented in chapter 2 and its simulation results are dis- 
cussed in chapters 4 and 5. This section briefly recapitulates the characteristics of 
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flii*- fcvl [Hdlilmi. 

1 lii-- uiiill ii iltjci 1 iv<’ })H)!>!(mii twDsiiioolh iininiodal fiindions, /n aiul / 12 . as 
shown in fisMiic LM 


xMiiiiinixc /n = . 

Miniini/c /,, = (.T-2)^ (6.1) 

'Fho 2.! is drawn in varialih' space. The Parelo-optinia! region can be found 

Ijy (‘xliaust i\'e s<'arch and using e<iua1iun 2.2. d he i)oints .rsj'j = 0 and a'j 2 = 2 are the 
r(“sj)ertive minima of /n and f\ 2 - The region in betwetui (0 < .r < 2) is the Pareto- 
ojjtinial regiiui. This rt'gion is shown in performance space in figure 2.2. Theetpaation 
of this front can lx* found by eliminating the variable x from the equations 6.1. This 
front is a smothli second order curve. 'I'his function was first u.sed by Vincent and 
Grantham (lf*>^l) to illustrate the concept (T Pareto-optimality. Later Schaffer (1984) 
used it as a preliminary test function for \'EGA. 


Problem F2 : A C‘’-continuous bimodal objective and a smooth 
unimodal objective: 

'fhis pixddem consists of two objectives. f 2 \ and / 22 . which arc : 

Minimize' /21 = -.r if ^ f 

= —2 + .r if 1 < .r < 3 

= 4 — X if 3 < .r’ < 4 

= -4 + X if a- > 4, and 

Minimize fxi = i-i’ ~ • (6-2) 

The first function, / 12 , is a C°-continuous function with minima at ,r = 1 and x -4. 
Also the differentials of this function at x = 1,3, and 4 do not exist. The second 
objectiv’e, f 22 - i^ ^ parabola with a miniinuin at x = 5. these two functions are shown 
in variable space in figure 6.1 and in performance space in figure 6.2. 
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The speci/ility of this prolth'm is its disjointed iioiidoniinated regions. These can 
1 m' seen in figure 6.2 as regions 1 < x < 2 and 4 < x < 5. Here the net length of the 
Par<'l(» optimal r<'gion is 2 units in variable space. I’hese disjointed regions are due 
to the two minima of /^i- Schaffer used this problem to test VEGAT ability to find 
the.sf' two disjtunted nondoniinated regions. This ])roblem is chosen for XSGA for 
th<' same purpose, and also to test its distributive powers in allocating its population 
members over tlu'se two disjointed regions. 

Problem F3 : Two-parameter, unimodal and monotonically 
decreasing objectives; 

This jjrobknn is used to test NSGA’s ability in optimizing multiparameter functions 
and distributing the poi>ulation over infinite nondominated region. This problem was 
solved by ('hankong and Haimes (1983) using a goal vector and weights for objectives. 
The objectives, /31 and f'j 2 , are : 

Minimize /31 = (xi — 2)^ + (x2 — 1)^ + 2, and 

Minimize /aa = 9xi — - 1)^- (6-3) 

In this thesis, the first two problems are considered for comparative analysis of 

VEGA and NSGA. Since these functions are test functions, some problem knowdedge 

is used to fix o-gj^^re parameter. In a later simulation, the knowledge is waived and 

CTghare computed according to equation 5.4. 

The objectives /31 and /32 are plotted in variable space as shown in figure 6.3. The 

T 

first objective is a smooth unimodal function which has a minimum at = {2, 1} . 
The second objective decreases monotonically with decreasing xj and increasing j5^2l• 
This can be observed in figure 6.4 (contour map). The contours of first function are 
concentric with the center at (2,1)* This function increases with inci easing diameter. 
The second function (parallel parabolas) constantly decreases along the line X 2 1 
towards decreasing Xj. Careful observation reveals that the tangential points of circles 
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aiul paialxild?- (linuiiiair all <)tti<’r poinis. '1 liis is Wcausc any surli tangential point is 
better in sccoikI ubjectivetiian all other points belonging to the same circle (same 
value). 1 hese tangential j)oin1s are Pareto-optimal points. Therefore, Pareto-optimal 
points may be fonml by eepiating the slopes (first differentials) of contour curves at 
common pcmits : 


I <1-^2 \ _ / dX2\ 

\(Lri ) \dxi j 


or, 

_ i-ri - 2) ^ 9 

2(a-2-l)' 

Assuming .r^ ^ 1 - and solving yield. 


Thus the Pareto opt imal r<'giun is rej)res<'nted by the straight line Xi = —2.5. Since 
flu' second oljjf'ctive. /:^ 2 , monotonically (Urreases the Pareto-optimal region repre- 
sented by straight line Tj = —2.5 is unbounded. At the singular points, X 2 = 1. 
observation shows that the nondominated points lie between xi = —2.5 and xj = 2. 
Then'fore tin* nondominated region is an infinite straight line, Xj •+•2.5 = 0, and seg- 
ment of line X 2 = 1 from Xj = -2.5 to Xj = 2. This region is marked in figure 6.4. 

1o make the comparisons better, exact nondominated points found above are 
coni]>ar('d with the simulation results. 

6.2 Performance measure 

In order to investigate how well NSGA and VEG.A have distributed individuals over 
the nondominated region, chi-square-like deviat ion form distribution measure devel- 
oped by Deb (1989) is used. The performance measure, t, is defined as 

Performance measure, t = 


9+1 

1 ^ 

1=1 


Hi 


cr, 


(6.4) 






49 


wlirtc t} is the iiuiuhn of dcsiird optiTiial jioiids and (f/+ subspacc is the doni- 

iiiafcd region, n, arlna! inuiiher of indi\'idnals sc'rving ?-tli subs])acp (niche) of 
iiondtnninated region, n, is expected number of individuals serving f-th subspace of 
nondoininated region, and is the variance of individuals serving ;-th subspace of 
nondoininated r(“gion. 

Tsing })robabilify tlx'ory it was e.stiinated elsewhere (Deb 1989) that 



where F is the j>opu!ation size. Since it is not desirable to have any individual in 
the dominated region ((f/d- l)-th subspace), = 0. That study also showed that 
^^+1 = distribution is exactly uniform, performance measure i = 0. 

I’herefore an algorithm with good distributing capability is characterized by a low 
(h'viafion measure. This measure can be used to compare the distributive powers 
of .\'S(I.A and \’K(iA. An id<*al distribution can be taken as an uniform spread of 
poj>iilation over the nondoininated regions. 

6.3 Simulation Results 

In this section, experimental results of NSGA and VEGA are presented. In all simu- 
lations for the first two problems, the GA parameters used in the experiments are as 
follows: 


Maximum generation : 500 

Population size : 100 

String length (binary code) : 32 

Probability of crossover : 1.0 

Probability of mutation : 0.0 


The parameters are held constant across all runs. Unbiased initial population is 
generated randomly spreading over entire variable space in consideration. To make 
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the comparison fair, exactly the same initial population has been used in VEGA and 
NSGA. lb confiruj and rerheck the results, each experiment is repeated five times 
with ditFerent initial population and the average performance is presented in each 
case. 


6.3.1 Problem Fl 

The population drift in cast* of VEGA and NSGA, was already compared in fig- 
ures 5.2 through 1.5 in chapters 1 and 5. In order to study the distribution pattern 
better, the nondominated search space (0,2) is divided into 10 equal sub-regions. 
Figures 6.5 and 6.6 show plots firawn with number of individuals in each sub-region 
and g(*m‘ration number. la case of VEGA (figure 6.5), after some generations, some 
of the sub- regions do not have rej>reseutati()n at all. These sub- regions represent mid- 
dling or utopian individuals. Observations based on a number of simulation results 
reveal that at moat thnx.* .sul)-regions are populated by VEGA. These are the points 
around individual optima. Whereas, in case of NSGA (figure 6.6), the number of in- 
dividuals in each sub-region fluctuated around value 10, which is exactly the expected 
number of points at each sub-region. It is very important to note that none of the 
sub-regions have zero number of individuals. To quantify this distribution capability 
of population over nondominated regions, the chi-square-like performance measure is 
calculated. 

To analyze the distribution using this performance measure, the nondominated 
region is divided into same 10 equal sub-regions (each having a length 0.2 units in 
variable space). Since a population of 100 individuals is used, the expected number 
of points per sub-region (n^) is 10* with a variance aj = 9. Therefore, the expected 
variance of dominated individuals ah = 90. The actual number of individuals in 
each sub-region are counted and deviation measure is calculated using equation 6.4. 

^Assuming that equal number of points are probable in each subregion, in general for any problem 
this may not be true. 
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Figun's 6.7 and 6.8 show <leviation measure versus generation number for VEGA 
and NSGA applied on fl. idgure 6.7 shows the average performance of five runs 
with different initial populations while taking the same initial population for VEGA 
and NSGA. Initially both methods start with high performance measure because the 
initial population is spread over <*ntire variable space, with less number of individuals 
in the nondominated region. V EGA's increasing measure with generation indicates its 
poor distributing ability. I’he initial descent is due to the convergence of population 
towards nondominated n-gion. At the same time NSGA with CTgj^are ~ (induced 
number of niches in nondominated region, q = 10), fluctuated at a low deviation 
measure. This is continued until generation 500 which is long enough to justify the 
stability of population distribution in 10 sub-regions. This shows the ability of NSGA 
in distributing population over nondominated region. 


In order to inve'stigate how sensitive the NSGA results on values, a number 

of values are tried. Figure 6.8 shows performance of NSGA with different 

cTghare make a fair compari.son, the initial population is taken to be same 

in all cases. There is not much difference in performance with = 0.1 and 

^share ~ shows that both the values resulted in successful distribution of 

population. But with a considerably high sharing parameter, o’gj^g^j.g = 1.0, NSGA’s 
performance is very poor. Similar observation can be made in case of negligible 
0-ghare without sharing. It is interesting to observe that although these two cases 
exhibit increasing measure they are not as bad as VEGA’s. This is due to the fact 
that equal reproductive potential (dummy fitness) is maintained for all nondominated 
individuals, thereby minimizing the bias against middling points. 


These results suggest that NSGA is effective in finding multiple Pareto-optimal 
solutions and is better than VEGA in that respect. 


.uNilK^L L^:KAR> 

I I. T.. KANPUR 


im. N&. A. 
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Generation number 

Figure 6.5: Number of individuals in each sub-region versus generation for Fl using 
VFXIA. 



Generation number 

Figure 6.6: Number of individuals in each sub-region versus generation for Fl using 
NSGA. 



Performance measure P Performance measure 
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Generation number 

7: Performance measure i for NSGA and VEGA on problem FI is plotted 
Deration number. An average of five runs is plotted. 



Figure 6.8: Effect of varying values. 




6.3.2 Problem F2 


I'hc twt) (lisjoint<*d Paroto-ojdiina regions arc marked in figure 6.2. The initial range 
for the variable, x. used in the simulations is [—10,10]. The population evolution is 
shown in figures 6.9 through 6.16. Both algorithms successfully identified disjointed 
nondoininat<'d r<*gions. But the differe'uce in distribution is clearly visible at 100-th 
and fiOO-th gfunuations. This result reiterates the ability of NSGA in distributing 
the population. The nondominated region is divided into 10 sub-regions to analyze 
distribution of population. Figures 6.17 and 6.18 shows the number of individuals in 
each sub-region versus generation. VEGA failed to sustain some of the sub-regions 
in this problem too, whereas NSGA successfully distributed individuals over both 
disjointed Pareto-optimal fronts. The deviation measure for these algorithms w'as 
similar in pattern to that of problem Fl. Figure 6.19 compares the performance 
measure of NSGA and \Qi:GA. 

6.3.3 Problem F3 

This problem has infinite Pareto-optimal region. This region (except for boundaries) 
is marked in figure 6.4. This problem was solved by Chankong and Haimes (1983) 
using a goal programming method. They assumed a goal vector and a weight vector 
for objectives, and considered the variable space xi,X 2 > 0. This completely elimi- 
nated the nondominated region Xi = —2.5. The solution is a single point along the 
line X 2 = l. In order to get other nondominated points, goal vectors as well as weight 
vectors are to be changed, and the problem has to be formulated again. This clearly 
shows the dependence of this method on goals and weights. An improper goal may 
some times result in a non Pareto-optimal solution. 

NSGA and VEGA are applied to this problem considering the variable space 
-20 < xi, X2 < 20. Due to this bounded search space the nondominated region 
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In a!! simulations, for tliis pruhl<“in. («A parameters used in experiments are ; 

Maximum gt'neralion : 500 

f\*]Milation si/e : 100 

String length (hinary code) : 30 (two 15-bit strings for each variable) 

Probability of crossover ; 1.0 

Probability of inutation : 0.0 

The paraiiK'ter for NSGA, calculated using equation 5.4, is found to be 8.9 

(f(jr imliicing 10 niclx's in the variable space). The experiments are conducted with 
(iiib'n'nl values (8.0, 8.5, and 9.0) and with different initial populations. The 

populaticui movement, in case of NSGA with ag^are = figures 6.20 

through 0 . 23 . For the same initial population the drift in VEGA is shown in fig- 
ures 0 . 2 ! through 0.27. Simulations with the other cTg^are similar to 

thcM* results. 

I'he final population (at generation 500) of NSGA is finely distributed along the 
line j'l = -2.5. At the same time VEGA’s population converged towards some 
.subdomains which arc nearer to the individual optima. It can be observed that NSGA 
faih'd to maintain some nondominated individuals which are on the line 0:2 = 1. At 
general ion 1 0, some individuals are present in the population. Their loss in subsequent 
generations can be attributed to the large o-ghare assumed as 

a hypersphere (circle in this case) of radius ^gj^^re’ points fall within 

a circle (induced peak). Thus, NSGA distributes strings to different niches, which 
may result in the loss of many closely packed points. This effect can be observed in 
case of points of the segment xj = 1- The length of this segment is very small, 4.5 
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Figure 6.19: Performance measure, t, for NSGA and VEGA on pro 











Ms!,ur<‘ (i.l’tl: ru|nila1it»n at pciicratioii 100 obtained using VEGA for problem F3 



Figure 6.27: Population at generation 500 obtained using VEGA for problem F3 
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Figur(’ 0.28: P»,>iu{lario!! al generation 700 obtained using NSGA with 



Chapter 7 


Multiobjective Truss Optimization 


In llii" < XSCA ajiplit'd ou two nmltiobjcctive truss optimization problems. 

I hf.sf iv.u wi*i»* xilvt'd Ity Ko>ki (1988) u.sing traditional methods. NSGA’s 

iiii’ with thoc Mdulioiis. 


7,1 Introduction 

'1 1 lUr load < an) iiii> .'•Inu'liues which appear frequently in a variety of industrial 
iipj'li' a.*!');; . Ail a; (di't'fi idwavs tries to save the material by minimizing weight 
(cu voliiiiaM of it stjiulnre. Weight reduction of a structure plays a major role in 
r!i:n:t!ii. !:i.L' ounal! installation cost of a factory. Often, the spans of these structures 
«iio wide iijni finis nnfavoralde <iefonnations may occur. .Some times these deflections 
may e,x< eerl ‘ i!:* d limits. In addition, many dynamic and crack propagation effects 

can he avoi^led iinliurtly hy preventing large displacements. Usually this problem 
is liaudh'd by foimnlating a single oi>tiinization problem — minimization of volume 
of the structure sulijected to dlspla<emeul constraints. But such constraints require 
the knowledge of limits for the displacements beforehand. Often the solutions may 
fall along constraint boundaries. Such solutions are, sometimes, undesirable. These 
difficulties sugg<‘st treating the most critical displacements as design objectives. This 


68 



69 


K'Milts in a limit ioUjed ive o]>1 iniizai ioii ])rol)l(‘in, with the following objectives : 
Minimize f(x) = { Ai, A 2 , A,„ , 

wh<‘re.r is tin' design vert or, 1 ' i.s the material volume of truss, and A,,? = 1.2. . . . ,m, 
is the /-th nodal displacement. The material volume, V, of a n-bar truss, can be 
expr<‘ssed as 

V = ZUL.A, 

where T, is the length of ?-th element and A,- is the area of cross section of that 
element. The cross section of an element of a truss, is assumed to be uniform over 
its length. The design variables of a truss can be length, cross sectional area, and 
some characteristic variables, which may include topological changes of structure, the 
angles between elements, etc. In this chapter two multiobjective truss problems, one 
with cross sectional areas as design variables and the other with areas and topological 
design variables, are considered. 

The solutions to this optimization problem will be the compromise alternatives 
that minimize both volume and critical displacements. A designer wants as many 
different designs as possible to select the best solution that suits his problem. To 
present such a set of solutions, NSGA may become a successful tool. The truss 
design is subjected to its feasibility (in case of changing topology) and the stresses 
induced in its elements. The induced stresses should not exceed the allowable limiting 
values. These stresses and the nodal displacements are calculated using finite element 
methods. This approach is briefly discussed in the following section. 

7.2 Analysis of Trusses Using Finite Elements 

A truss is assumed as a number of bar-elements connected by hinges to each other 
and by supports to the base. An element of a truss is considered as a one-dimensional 
axial bar in the local coordinate system, as shown in figure 7.1 (Chandrupatla and 



70 


1 he local coorcliiialc systrui consists an axis that coincides witli 

the elemental axis. 

The local slifFne.ss matrix, k, , is given by 


k, = 


Ml 

I, 


’ 1 -] 
-1 1 


I 


\vher<‘ A, is the 'loiings modulus of element e, A( is tlic cross sectional area and T is 
the element length. Assuming the element makes a positive angle, 0, with the global 
axis, the global stiffness matrix can be found (Bathe, 1990) : 


Ml 

I 


cos^ 6 cos 6 sin 0 — cos^ 9 —cos 6 sin 9 

sin^ 9 —cos 9 sin 9 — sin^ 9 

symmetric cos^ 9 cos 6 sin 9 

sin^ 9 


The truss is analyzed by assembling all elemental equations and by applying boundary 
conditions, before solving the matrices for unknown displacements. The assembled 
matrix equation can be written as 


Ku = F, 

where K is global stiffness matrix (assembled), u is displacement vector, and F is the 
load vector. The unknowns, u, are solved from the above equations, using a numer- 
ical method, after satisfying the boundary conditions. The force in each member is 
calculated from individual elemental equations, after solving the nodal displacement 
vector. These forces are used to compute the stresses induced in each element. A 
FORTRAN code has been developed to implement this approach to analyze a truss. 

7.3 Four-Bar Truss Problem 

A Four-bar truss problem with cross sectional area as design variables, and objectives 
as volume and a critical nodal displacement, is considered as an application for NSGA. 
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V' 


Y 



Figure 7.1: Truss element shown in local and global coordinates. U and V are nodal 
displacements in global coordinate system XY ^ and u and v are nodal displacements 
in local coordinate system xy. 
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I !i<' stnuinrc aint 11 k* htading. aiul ilia <lisj)lac<‘nK'nl criterion are shown in figure 7.2. 
'i'h<' figun' also shows llie dimensions of each element. 

I’he ctmstraints imjw.sed on the two objectives are the stress limits and area 
bounds. I’lu' material Young’s modulus is assumed to be = 2 x 10'* kN/cm^. The 
allowable stress limits are taken as 10 kN/cm^ in tension and —10 kN/cm^ in com- 
pression. The design sjiace (variable space) considered for each cross sectional area 
is 0 < Ai < bem^,? = l",2,3,4. Thus, the two-objective four-bar truss optimization 
problem formulated as 


Minimize V and A 2 , 


subject to 


-lOkN/cm^ < <^. < lOkN/cm^, i = 1,2, 3.4 (7.1) 

0 < Ai < 5cm^. i = l,2,3.4 

This problem was solved by J. Koski (1988) using a weighted goal programming 
method, imposing a goal on deflection. He assumed a desirable displacement Aj = 
0.6. Table 7.1 shows these results. 

These results are obtained by changing the weights for objectives, while imposing 
same goal on deflection, and repeating the algorithm to get diiferent Pareto-optimal 
points. It is interesting to note that, fourth and fifth designs are dominated by 
second design. This shows that, even if different weights are used. Pareto-optimal 
points may not be found. Another traditional approach to solve multiobjective truss 
optimization problems can be found in Rao et al (1992). This approach uses a fuzzy 
goal programming method. 

An exhaustive nondominated sorting search has been made, by discretizing the 
search space, to identify the Pareto-optimal regions. Later, NSGA is applied on this 
problem with the following parameters. 
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TiiKlf 7.1: ohiaiiK'd in .1. Koski (198R) using a weighted goal programming 

iiH'fliod for foiir-har truss problem. 


Design index 

Volume 

V cin'^ 

Deflection 
A 2 cm 

1 

2819 

0.617 

2 

2920 

0.596 

3 

2940 

0.592 

4 

2931 

0.602 

5 

2933 

0.600 


Maximum geiun-ation 
Population size 
String length (binary code) 
Probability of crossover 
Probability of mutation 

^share 


500 

100 

32 (Four 8-bit strings for each variable) 
1.0 
0.0 

1.7 (Calculated using equation 5.4) 


The c^share is calculated by identifying the feasible region and inducing 10 niches 
in it. The results are shown in figures 7.3 through 7.6 drawn in performance space. 
The initial population, figure 7.3, has very few feasible points. Subsequent figures 
show the Pareto-optimal points are distributed along the first front. The ideal distri- 
bution in this case cannot be found because of the complexity of objectives (deflection 
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fiiiir! icJii hxjx'riiiieiits revealed that th(‘ initial feasible po])iila.tion effects the dis- 
tribution of population in succeeding geixu'ations. Therefore, NSGA is tried with a 
small iiiiitatioii (prol)ahility of inutation = 0.01) and with a crossover probability 
= 0.8, wliile keeping the other parameters same as above. The final result, popula- 
tion at genc?ration 500, is shown in figure /.7. In this case the spread of population is 
more than that in NSGA without mutation. Also, NSGA found some Pareto-optimal 
solutions found by Koski (table 7.1) using traditional method. These results show 
t}i<" successful implementation of NSGA in above truss problem. 


7 .4 Eight-Bar Truss Optimization with Changing 
Topology 

Some structures like towers, with a large number of elements, can be able to with 
stand and serve the purpose even if some panels or elements are removed. This 
minimization problem is an interesting aspect in engineering design. In topology 
optimization, the number of members and joints defining the truss itself varies. 

An eight-bar truss shown in figure 7.8, is considered. The truss volume and its 
outer node deflection are the objectives. The design variables are the cross sectional 
areas and topological variables. In this problem only the number of elements is 
considered as topological variable. This problem is much more complicated than 
the previous problem considered, because of more design variables and topological 
alternatives involved. Early GA application to topology optimization can be found 
in Krishnamoorthy and Rajeev (1993). They implemented a new approach, called 
variable length genetic algorithm, VGA. In this method the number of design variable 
(areas) itself is an unknown. This Wcis implemented by using a control variable that 
determines the number of panels or an individual’s string length. The population 
consists of strings of different length. Some single-objective topology optimization 
problems were solved by them, using this approach. 
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Figure 7.3; Population at general 
lem. 
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Figure 7.4: Population at gei 
problem. 









Figure 7 . 8 : Eight -bar truss multiobjective optimization problem. The load value F 
= 100 kN, and L = 100 cm. 



82 


In this tlH’sis, the topology is haiicllcd by rejuoving an element, if its area of cross 
se(1i«>n is negligible. This way, by defining the negligible limit, the topological vari- 
ables can be assigiH*d to some schemata. These schemata represent strings belonging 
to tlu' region between negligible area value and actual zero value. This may help 
in exj)editing the NSGA convergence tow'ards Pareto-optimal regions. When an ele- 
ment’s area falls below the limit, that element is removed and the feasibility of the 
structure is checked. If the truss is feasible, it is analyzed for stresses and outer node 
deflection. A bracket operator penalty function (Rao, 1991) is used to transform the 
constrained objective to a single function. The stress limits were taken as 14 kN/cm^ 
in tension, and —8 kN/cm^ in compression. The area bounds are taken as 0 cm^ and 
30 cm^, and assumed that if an elemental area falls below 5cm^, that element should 
be removed. It w’as also observed that if any element’s cross sectional area is less than 
5cm^, the stresses induced in that element are greater than 2 to 3 times the limiting 
stresses. The Young’s modulus for the material is assumed as IS = 2 x lO'* kN/cm^. 

Using these values Koski (1988) repeated weighting method, with different weights, 
to find the Pareto-optimal points. This front is approximated with help of differ- 
ent Pareto-optimal values obtained with different weights. This front is used to 
compare NSGA’s results. The parameters used in NSGA simulation are as follow^s 

250 

200 

64 (Eight 8-bit strings for each variable) 

1.0 
0.0 

30.0 (Calculated considering 
entire variable space, 
to induce 10 niches.) 

Fig.ures 7.9 through 7.12 show the population at different generations. Here the 
Pareto-optimal points shown in solid diamonds are taken from Koski (1988). The 


Maximum generation 
Population size 
String length (binary code) 
Probability of crossover 
Probability of mutation 

“^share 
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'I'aWc 7.2: 'I’ypical topological optima found by NSGA. The areas are given in cin^, 
vohinie in cni~\ and deflection in nun. Zero area indicates the absence of that member. 


Design 


^2 

^3 

A4 

^5 

Ae 

Ar 

As 

Volume 

Deflection 

1 

29.6 

29.8 

28.0 

14.0 

28.4 

0 

11.76 

10.9 

18676.8 

1.52 

2 

28.7 

24.2 

29.4 

7.7 

29.64 

9.7 

9.05 

0 

16426.9 

1.66 

3 

21.2 

17.4 

20.8 

7.5 

29.4 

7.8 

11.8 

6.1 

14584.1 

2.08 

4 

19.6 

21.7 

15.6 

10.5 

23.7 

7.6 

0 

7.17 

12636.1 

2.31 

5 

13.7 

13.6 

19.0 

14.7 

20.4 

0 

8.9 

10.2 

12012.1 

2.32 


representation of the performance space itself is very difficult as the topological ob- 
jective is another implicit dimension. This can be observed from the table 7.2 that 
different topological designs have similar volume or deflection. 

Figure 7.13 compares two NSGA populations at generation 100, obtained using 
different initial populations. These two populations converged to two different regions. , 
This suggests to use NSGA with mutation. Figure 7.14 shows the population obtained 
by NSGA with mutation probability, pm = 0.01, and cross over probability, pc = 0.8. 
Here the distribution is more, but convergence is slower. The NSGA solutions are close 
to Koski results. One reason for deviation could be that only 8-bits (or 256 areas) are 
permissible in NSGA. Taking higher string length may provide closer results. Further 
possible extensions and modifications that make NSGA more robust are discussed in 
the next chapter. 


7.5 Summary 

This chapter presented successful application of NSGA to two real-world engineering 
optimization problems. Truss material minimization plays important role in mini- 
mizing its cost, but large structures will have undesirable displacements which are 
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Figure 7.10; Population at generation 10 obtained using NSGA for eight-bar trus; 
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12: Population at generation 250 obtained using NSGA for eight-bai truss 
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Figure 7.13: Comparison of population at generation 100 obtained using NSGA with 
dijfferent initial populations. 





Figure 7.14: Population at generation 250 obtained using NSGA with mutation for 
eight-bar truss problem. 
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to l>f niiniiiiizrd. 1 '\m' an ciip.iiK'f'r it sfcnis more ridvantagc'ons l,(j treat volume of a 
tni''S and rritiea! di.s])larenieiits as iiidejK'iideiit ohjoctives. He always desires a set 
of <onii>romis<' solutions instead of single alternative. To achieve such a goal. NSGA 
may he used efliciently. In this chapter, two bicriteria truss optimization problems 
ar<’ considered. In the first problem, volume of a truss and a nodal deflection are con- 
sidered as objectives, subjected to limiting stresses. The design variables are cross 
.sectional areas of elements. NSGA is successful in distributing its population over a 
large portion in the nondominated fronts. The second problem, with similar objec- 
tives, but having additional variables in the form of topology changes, is solved by 
NSGA. Although this problem is more complicated, NSGA is able to find multiple 
Pareto-optimal points. 

The results obtained show promising future of NSGA. Some possible extensions 
to this algorithm and future scope of research are discussed in the next chapter. 



Chapter 8 


Extensions 


This thesis implemented the idea of nondominated sorting to solve multiobjective op- 
timization problems. The results obtained show a promising future to this algorithm. 
Since this thesis implements NSGA for the first time, the robustness of NSGA can 
be questioned. Even this version of NSGA, with fitness sharing, proved to be much 
more robust than other GA approach VEGA. It can be modified and extended to 
solve wide variety of problems. This chapter discusses such possible extensions. 

A number of extensions of this study can be pursued: 

1. The parameter plays major role in distributing NSGA’s population. 

This is because the number of niches induced in the variable space are ft.xed 
by this parameter. This thesis examined the effect of varying c^sJ^iare 

But detailed study in this area is an interesting avenue for further research. 

2. Even though two objectives are used in both real-world problems, more 
objectives can be handled with NSGA. Moreover, the objectives need not 
be all minimization type, some of them could be minimization type and 
some could be of maximization type. In both situations, the definition of 
nondominated points will change, but the NSGA algorithm will remain the 
same. Unlike VEGA, the population size may not increase linearly with 
the number of objectives in NSGA. In VEGA, the population needs to 
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1)(' (iiciiiftcfl liiK'aiiy hcoausc thr wliok' i>oi)ulatioii dcccLs to ho divided to 
Ix' used ill seleclion for each ohj<'ctiv<\s. Unless VEGA’s population is in- 
creasedjl is not jK>ssil>l<' to minimize the bias in its selection. With NSGA, 
the population .siz(‘ reciuiremcnt may be more with number of objectives, 
but how the size* requirement would increase is a matter of interesting 
future research. 

3. The ranking selection in NSGA is implemented by introducing dummy 
fitness values. However, this will not control the selection pressure. To 
incorporate such control, proper fitness scaling method (Goldberg. 1989) 
needs to be used. By scaling the dummy fitness values, the best nondomi- 
nated point can be set to get required number of copies, while setting the 
worst dominated point's copies to zero. This way selection pressure can 
be controlled. Another selection approach that can be used is discussed 
below. 

4. It has been found elsewhere (Goldberg and Deb, 1991) that tournament 

IP' 

selection puts a more controlled selection pressure and has a faster conver- 
gence than proportionate selection method used in this study. The nich- 
ing technique suggested by Oei, Goldberg and Chang (1992) can be tried 
with tournament selection to replace sharing and proportionate selection 
in NSGA for more controlled and hopefully faster solutions. 


Finally, other advanced operators like inversion, multipoint crossover etc., can be 
incorporated. Schemes such as mating restriction (Goldberg, 1989), used in conjunc- 
tion with niche and speciation techniques, may enhance the robustness of NSGA. 



Chapter 9 


Conclusions 


Multiobjective optimization is different from single-objective optimization, in the 
sense that no unique solution exists in the former case, rather the solution comprises 
a set of possible alternatives, known as nondominated or Pareto-optimal points. Even 
though there exists a number of classical multiobjective optimization techniques, they 
require some a priori problem information. Most of these algorithms scalarize an ob- 
jecive vector using weights or goals, resulting in a single point solution to the problem. 
Often times the obtained solution may not be a Pareto-optimum solution. This thesis 
have overviewed three such methods that are commonly used in traditional multiob- 
jective optimization. 

Since genetic algorithms use a population points, they are suitable to find mul- 
tiple Pareto-optimal solutions simultaneously. Schaffer’s vector evaluated genetic al- 
gorithm (\'’EGA) was an early effort along this direction. But his VEGA suffered 
dll'- to its bias against some middling nondominated points. Its individual selection 
resulted in a population drift towards individual optima of objectives, instead of find- 
ing maximum possible Pareto-optima points. Experimental results presented in this 
thesis, similar to what Schaffer had found, have shown this drawback. 

A new approach, a nondominated sorting genetic algorithm suggested by David 
Goldberg, has been described and implemented in this thesis. Three test problems 
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usrfl in (il}i<>r studifs lijivc hci’ii w']<‘ct('(i. Simulation rfsult.s on throe test problems 
hav<‘ shown that Ifiis algorithm (named as NSCIA) can maintain stable and uniform 
n'produft iv<* [xitential across nondominated individuals, vvliich is a serious drawback 
of \'E(1A. d he j)Ower of NSGA lies in the successful transformation of a multiobjec- 
tiv(‘ problem, no matter how many objectives are there, to a single function problem 
without loosing the concept of vector oj)timization. This enables NSGA to identify 
th<‘ building blocks that represent Pareto-oj)timal regions. The results suggest that 
NSGA can be used to find different Pareto-optimal solutions, the knowledge of which 
could be very useful to the designers or decision makers. The successful application of 
NSGA to tw'o engineering multiobjective optimization problems suggests immediate 
application of NSGA in more complex engineering problems. A number of sugges- 
tions for immediate extension and application of NSGA to several multiobjective 
optimization problems has also been discussed. 



References 


Bathe, K. J. (1990). Finiit element procedures in engineering analysis. New Delhi: 
Prentice Hall of India. 

Chandrupatla, T. R. and Belegundu, D. A. (1991). Introduction to finite elements in 
engineering. New Delhi: Prentice Hall of India. 

Chankong, V. and Haimes, Y. Y.-(1983). Mulhobjective decision making theory and 
methodology. New York: North-Holland. 

Deb, K. (1989). Genetic algorithms in multimodal function optimization. Masters 
thesis. University of Alabama. (TCGA Report No. 89002). The Clearinghouse for 
Genetic algorithms, University of Alabama. Tuscaloosa. 

Deb, K. and Goldberg, D. E. (1991). An Investigation of niches and species formation 
in genetic function optimization. Proceedings of the Third International Conference 
on Genetic Algorithms, J. D. Schaffer(Ed.)(pp 42-50). San Mateo, CA: Morgan Kauf- 
man. 


95 



96 


1)<'1), K. {199.{). (if'tif'lic algorithiiis for oiigincoring design optiniizalion. Advanced 
Study !nsti(ut( on Compufalional Methods for Engineering Analysis and Design. J. N. 
H<-ddy, ('. S. Krislniainoorthy, and K. N. S(‘eU)aranui (coordinators) (pp 12.1-12.25). 
Indian Institnt<‘ of 'I’eclinology, Madras. 

Ci!oIdl)erg, D. L. (1989). Genetic algorithms in search, optimization and machine 
learning. Heading, NY: Addison- Wesley. 

Goldberg, D. E. and Deb, K. (1991). A comparative analysis of selection schemes 
used in genetic algorithms. Foundations of Genetic Algorithms (69-93). San Mateo, 
CA: Morgan Kaufman. 

Goldberg, D. E. and Richardson, J. (1987). Genetic algorithms with sharing for mul- 
timodal function optimization. Genetic Algorithms and Their Applications: Proceed- 
ings of the Second International Conference on Genetic Algorithms, J. J. Grefenstette 
(Ed.) (41-49). 

Hans, A. E. (1988). Multicriteria optimization for highly accurate systems. Multi- 
criteria Optimization in Engineering and Sciences, W. Stadler(Ed.), Mathematical 
concepts and methods in science and engineering, 19, 309-352. New York: Plenum 
press. 

Holland, J. H. (1975) Adaptation in natural and artificial systems. Ann Arbor: Uni- 
versity of Michigan Press. 

Krislinamoorthy, C. S. and Rajeev, S. (1993). Structural optimization using genetic 
algorithms. Advanced Study Institute on Computational Methods for Engineering 
Analysis and Design. J. N. Reddy, C. S. Krishnamoorthy, and K. N. Seetharamu 
(coordinators) (pp 13.1-13.21). Indian Institute of Technology, Madras. 



0('i, (’. K. (Jolfilx ‘rg, D. Fj. and (’liang. S. (1991). Tournameni selection, niching and 
ih( pvt s( ri'dlion of diversity^ (IlliGAL Report No; 910011). University of Illinois. 
Urhana. 

Rao, S. S. (1991). Optimization theory and application. New Delhi: Wiley Eastern 
Limited. 

Rao, S. S. Sundararaju, K. Prakash, B. G. and Balakrishna, C. (1992). Fuzzy goal 
programming approach for structural optimization. Journal of Structural Optimiza- 
tion, 30, 5, 1425-1432. 

Rosenberg, R. S. (1967). Simulation of genetic populations with biochemical proper- 
ties. Doctoral dissertation, University of Michigan. Dissertation Abstracts Intei na- 
tional, £8(7) 2734 B. (University Microfilms No:67-17,836). 

Schaffer, J. D. (1984). Some experiments in machine learning using vector evaluated 
genetic algorithms. Doctoral dissertation, Vanderbilt University, Electrical Engineer- 
ing, Tennessee. (TCGA file No. 00314). 

Tamura, K. and Miura, S. (1979). Necessary and sufficient conditions for local and 
global nondominated solutions in decision problems with multiobjectives. Journal of 
Optimization Theory and Applications, 27, 509-523. 

Vincent, T. L. and Grantham, G. J. (1981). Optimality in parametric systems. New 
York; John Wiley and sons. 




C2£>‘OOHx 

S!ff> 

dati* stamped 



(no£- 1 M-f'i-SRi- moi. 



